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@ Data correction subsystenn and method for image processing. 



@ A data correction subsystem (3) for a colour 
image processing system having a colour image 
reading device (1) and a colour image printing 
device (5). A chart file (31) is transmitted to the 
printing device so that the printing device pro- 
duces a sample chart (51). Calibration data (37) 
is calculated from read sample data so that the 
read sample data can be corrected to corre- 
sponding data in the chart file. The read sample 
data is obtained by causing the reading device 
to read the sample chart Printing data to be 
transmitted to the printing device Is correcting 
using the calibration data. 
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The present invention relates to a data conrection subsystem and method for improving the grey density 
of an image processing system and in particular the grey density and colour reproduction of a colour image 
processing system, such as a computer image processing device, a copying device, or a facsimile transmission 
system. 

5 A typical colour image processing system comprises an image reading device, such as an image scanner, 

for producing image data from an original image, a host computer for processing the image data, and a colour 
printer for printing out images in response to the processed image data. One of the problenns encountered by 
such a system Is that the grey density and colour of the original Image are not faithfully reproduced. 

A major reason for this problem Is the discrepancy between the input/output characteristic of the image 

10 reading device and the input/output characteristic of the printer. Specifically, a non-linear Input characteristic 
is generally observed in any type of device. While the input characteristic of the image reading device is gen- 
erally relatively linear, that of the printer is relatively non-linear. As a result, the grey density and colours of the 
original image are not faithfully reproduced. Further, the printer cannot produce the entire density range of the 
original image and. In particular, cannot reproduce extremely high density regions. This is also one of the caus- 

15 es of impaired grey density and colour reproduction. 

The present invention has been made In view of the above circumstances and has as an object to provide 
a data correction subsystem which allows faithful reproduction of an original image even if there is a discrep- 
ancy between the Input/output characteristic of an image reading device and that of a printer in a colour image 
processing system. 

20 Another object of the invention is to provide a data correction subsystem which allows faithful reproduction 

of an original image even if the printable density range is limited in the data correction subsystem. 

Still another object of the Invention is to provide a simple processing procedure for executing data correc- 
tion processing using a computer. 

Yet another object of the Invention is to provide a colour Image processing system having a flexible con- 
25 figuration. 

Additional objects and advantages of the invention will be set forth in part in the description which follows 
and in parts will be obvious from the description, or may be learned by practice of the invention. The objects 
and advantages of the invention may be realised and attained by means of Instrumentalities and combinations 
particularly pointed out in the appended claims. 

30 To achieve the objects and In accordance with the purpose of the invention, as embodied and broadly de- 

scribed herein. In a first embodiment, the invention provides a data correction subsystem for an image proc- 
essing system having an Image reading device and an image printing device Is provided, the data correction 
subsystem being characterised by comprising: transmitting means for transmitting a chart file to the printing 
device so that the printing device produces a sample chart; calibration data calculation means for calculating 

35 calibration data from read sample data so that the read sample data can be corrected to conresponding data 
in the chart file, the read sample data being obtained by causing the reading device to read the sample chart; 
and calibration means for correcting printing data transmitted to the printing device using the calibration data. 

In a preferred embodiment, the calibration data includes y calibration data for correcting grey density and 
colour calibration data for correcting a colour. The y calibration data is, e.g., a conversion table for converting 

40 an inputted grey density value to another density value and outputting the converted density value. The colour 
calibration data Is, e.g., a 3x3 matrix filter by which three primary colour components that Indicate a colour 
are multiplied. To correct printing data, a printing data is subjected first to grey density correction with the y 
calibration data and then to colour correction with the colour calibration data. 

Preferably the image processing system is a colour image processing system constructed of a colour print- 

45 ing device, a colour image reading device, and a computer. Preferably, the calibration means is disposed within 
the reading device so that correction is made only to image data produced by the reading device. However, 
the system may be modified such that all data to be sent to the printing device can be corrected, whether or 
not the data is the image data produced by the reading device, by providing the calibration means within the 
computer. Further, in the case where a plurality of types of printing devices can be used selectively or concur- 

50 rently as the printing device, calibration data respectively dedicated to such a plurality of usable types of print- 
ing devices may be calculated and saved in advance, so that calibration data to be used for correction may be 
selected in accordance with the type of printing devices actually used. 

To calculate the y calibration data, first, the read sample data is subjected to normalisation processing to 
expand a grey density distribution region toward a higher density side. Then, a point of change in a density 

55 value is detected by scanning grey density values of the normalised read sample data. Conversion data for 
converting the grey density value of the read sample data at the detected point of change into a grey density 
value of the chart file data corresponding to the point of change is prepared, and the prepared conversion data 
Is made into the y calibration data. 
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To calculate the colour calibration data, first, only colour data In the change file Is sampled from the read 
sample data, the colour data corresponding to a predetermined colour within a range of colours that can be 
outputted by the printing device. Then, a 3x3 matrix filter is used to minimise an error between the sampled 
colour data and the corresponding colour data in the chartflie. Normalisation processing Is thereafter executed 
5 to make lightness components with respect to the three primary colours of the calculated matrix filter equal 
to one another, and the thus normalised matrix filter is made the colour calibration data, ft may be noted that 
better results could be obtained, In some cases, by sampling only colour data corresponding to a predetemilned 
colour outside the range of colours that can be outputted by the printer in the aforementioned sampling oper- 
ation. 

10 The system first gives a predetenfnined chart file to the printing device and prints out a sample chart de- 
scribed by the chart file. The sample chart reflects the input/output characteristic of the printing device. Then, 
the sample chart is read by the reading device. Data obtained by causing the reading device to read the sample 
chart reflects the input/output characteristic of the reading device superimposed upon the input/output char- 
acteristic of the printing device (since the input/output characteristic of the reading device is almost linear, It 

15 is the input/output characteristic of the printing device that is substantially reflected). Then, calibration data is 
calculated from the read data, the calibratbn data being such as to correct the read data to the original chart 
file data. 

In this way, the calibration data becomes conversion data that has a substantially inverse characteristic 
with respect to the input/output characteristic of the printing device. Printing data with thereafter be corrected 

20 using the calibration data, and the con-ected data will then be sent to the printing device. As a result, the cor- 
rection made by the calibration data cancels out the input/output characteristic of the printing device, which in 
turn allows an image having faithful colour and grey density reproduction to be printed out. 

Further, since the calibration data conforms to the Input/out characteristic of a printing device that Is ac- 
tually used, the best correction specific to the printing device can be implemented. In addition, the calibration 

25 data is freely changed in accordance with the type of printing device. Some conventional examples (e.g., Un- 
examined Japanese Patent Publications Nos. Hei. 3-76471 and Hei. 5-183740) are designed so that appro- 
priate calibration data Is selected from a calibration data set prepared in a ROM ir) advance. However, com- 
pared with such conventbnal examples, the subsystem of the invention can provide a higher degree of freedom 
in handling optimisation of conrection and change of the printing device. In addition, while the aforementioned 

30 two conventional examples employ the sample chart that has been prepared in advance, the subsystem of 
the invention is characterised as using a printout obtained by giving data to a printing device, which means 
that the subsystem can cover all colours that are to be possibly printed without being limited by the colour range 
specified in the sample chart that has been prepared In advance. Hence, the subsystem of the invention is 
applicable to future printing devices. 

35 Still further, the subsystem of the invention may function as a measuring instrument that measures the y 
characteristic and colour correction coefficient of a printing device if the calculated calibration data is made 
usable independently of the calibration means. 

A system formed of a printing device, a reading device, and a computer such as an embodiment that will 
be described below can incorporate the calibration means in the reading device. In the computer, or In the print- 

40 ing device. If the calibration means is located In the reading device, there is an advantage that printing device 
changes and computer application software changes that take place relatively frequently can be handled with 
ease. On the other hand. If the calibration means is located in the computer, there are a plurality of advantages: 
printer changes can be handled with ease; application changes can be handled if located In the operating sys- 
tem of the computer; and data inputted through means other than the reading device can also be corrected. 

45 The third advantage Is also provided when the calibration means Is located In the printing device. 

Since a system that frequently prints out data inputted through means other than the Image reading device 
connected thereto such as a copying machine and a facsimile transmission/reception system, each serving 
also as a printer, can particularly enjoy the aforementioned three advantages, it is preferred that the calibration 
means be located in a component other than the reading device in this type of system. 

50 A system that can use a plurality of types of printing devices selectively or concurrently can enjoy an ad- 
vantage that the subsystem of the invention is freely applicable to any type of printer as long as calibration 
data dedicated to each of a plurality printers is saved in the system and appropriate calibration data Is selected 
from the saved calibration data in accordance with the type of printing device actually used. 

In the subsystem of the invention, If y calibration data for grey density correction and colour calibration 

55 data for colour correction are prepared as calibration data, and printing data Is subjected first to grey density 
conrection with the y calibration data, and then to colour correction with the colour calibration data, then sat- 
isfactory grey density and colour reproduction may. In some cases, be obtained only through relatively simple 
colour correction processing. That is, conventionally known colour correction processing (e.g.. Unexamined 
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Japanese Patent Publication No. Hei. 5-122513) involves the three steps of: expanding the amount of data in 
the high density region by subjecting original data to luminance data conversion processing using a logarithmic 
conversion curve; colour-correcting the thus processed data using a 3x3 matrix filter; and correcting the grey 
density of the thus corrected data. However, when the grey density con-ection using the y calibration data is 
5 performed first as described above, particularly in the case of a system using a printing device whose input/out- 
put characteristic is noticeably nonlinear (e.g., an Inkjet printer), the y calibration data has a conversion char- 
acteristic that is extremely close to the aforementioned logarithmic conversion curve. Therefore, only the grey 
density correction is enough to obtain the same effect as that provided by executing both the conventional 
luminance conversion processing and the grey density con-ection processing concurrently. Therefore, satis- 
10 factory grey density and colour reproduction that are substantially equivalent to that obtained by the conven- 
tional three-step processing can be obtained by the two step processing involving the grey density correction 
using the y calibration data and the colour correction processing using the 3x3 matrix filter. 

In the case of calibration the y calibration data, If the read sample data is subjected to normalisation proc- 
essing that Is designed to expand the grey density distribution range toward the high density side, then a dy- 
15 namic range in the high density region in a reproduced image obtained by printing out the printing data is ex- 
panded, so that a reproduced image having a satisfactory appearance can be obtained. 

In the case of calculating the y calibration data, if the steps of: first detecting a point of change In the density 
value by scanning the grey density values of read sample data; then preparing conversion data for converting 
the grey density values of the read sample data at the detected point of change into the grey density values 
20 of the corresponding chart file data; and making the prepared conversion data the y calibration data, are per- 
formed, then this processing can actually be executed by such a simple operation as to reference the read 
sample data and the chart file stored in memory. 

In calculating the colour calibration data If only colour data in the chart file corresponding to colours within 
the range of colours that can be outputted by the printing device is sampled and calculated, then grey density 
25 and colour reproduction for halftone colours that can be outputted by the printing device Improves, which in 
turn allows ordinary photographs consisting of many half tone colours to be reproduced faithfully. On the other 
hand, in the case of using data corresponding to colours outside the range of colours that can be outputted 
by the printing device by means of sampling, then the colours are corrected so as to be close to the primary 
colours. Therefore, this subsystem Is suitably applied to cases where original images using many primary col- 
30 ours such as posters are to be reproduced clearly. 

In the case of using a 3x3 matrix filter as the colour calibration data, if such normalisation processing as 
to make the lightness components of the matrix filter equal to one another for the three colours Is executed, 
then an advantage that grey balance is not lost in colour correction can be obtained. 

In a second embodiment, this invention provides a data correction method for an Image processing system 
35 having an image reading device and an image printing device, comprising the steps of: 

transmitting a chart file to the printing device so that the printing device produces a sample chart; 
calculating calibration data from read sample data so that the read sample data can be corrected to cor- 
responding data in the chart file, the read sample data being obtained by causing the reading device to read 
the sample chart; and 

40 correcting printing data to be transmitted to the printing device using the calibration data. 

In a third embodiment, this Invention provides an Image processing system, comprising: 
an image reading device; 
an Image printing device; 

transmitting means for transmitting a chart file to the printing device so that the printing device produces 
45 a sample chart; 

calibration data calculation means for calculating calibration data from read sample data so that the read 
sample data can be corrected to corresponding data In the chart file, the read sample data being obtained by 
causing the reading device to read the sample chart; and 

calibration means for conrecting printing data to be transmitted to the printing device using the calibration 

so data. 

In a fourth embodiment, this invention provides an Image processing method, comprising the steps of: 
printing a sample chart In accordance with a chart file; 
reading the chart file to produce first image data; 
comparing the first image data with the chart file; 
55 calculating calibration data in accordance with the comparison of the first Image data with the chart file: 

reading an image to produce second image data; and 
conrecting the second image data in accordance with the calibration data. 
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate 
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exemplary embodiments of the invention and, together with the description, serve to explain the objects, ad- 
vantages and principles of the Invention. In the drawings: 

Fig. 1 is a block diagram of a colour image processing system to which a data correction subsystem of the 

invention is applied; 
5 Fig. 2 is a flowchart of a file preparation process; 

Fig. 3 is a block diagram of an image scanner; 

Fig. 4 is a diagram of a sample chart; 

Fig. 5 is a diagram of a y calibration chart in the sample chart; 
Fig. 6 is a diagram of a colour calibration chart In the sample chart; 
10 Fig. 7 is a graph of an input/output characteristic of a printer; 

Fig. 8 is a graph of a printer calibration y curve, an inverse function of the printer y characteristic curve of 
Fig. 7; 

Fig. 9 is a flowchart of the process for calculating the printer calibration y curve table; 
Fig. 10 Is a diagram showing a position at which data is picked up from each t>atch of the sample chart; 
IS Fig. 11 is a diagram showing exemplary data Interpolation based on a linear interpolation method effected 

during the y curve table calculation process; 

Figs. 12A and 12B are a graphical representation of normalisation processing performed in the y curve 
table calculation process; 

Fig. 13 is a table of read data and a table of chart file data after the read data and the chart file data have 
20 been subjected to normalisation processing, the tables being developed in a main memory; 

Fig, 14 is a calibration y curve table; 

Fig. 15 is a graphical representation of a colour correction coefficient; and 

Fig. 16 is a flowchart showing a flow of the process for calculating the colour correction coefficient. 
Fig. 1 shows an exemplary configuration of a colour Image processing system to which a data correction 
25 subsystem of the invention Is applied. 

As shown in Fig. 1 , this system Includes an image scanner 1 , a host computer 3, and a colour printer 5. 
The image scanner 1 has the basic function of reading an original colour image to produce image data, and 
sending the image data to the host computer 3. The host computer 3 has the basic function of performing va- 
rious operations corresponding to business applications with respect to the image data received from the im- 
30 age scanner 1 and outputting the thus processed image data to the colour printer 5. The colour printer 5 has 
the function of printing out a reproduced colour image based on the image data from the host computer 3. 

In addition to the aforementioned basic functions, the Image scanner 1 and the host computer 3 have some 
other functions Including that of correcting the image data to improve reproduction of the grey density and col- 
our of the original Image. The correction operation (hereinafter referred to as "calibration") will be described 
3S \n detail below. 

The calibration operation is roughly divided into two phases. The first phase, although somewhat prelim- 
inary, fornns the main part of the operation. In the first phase (hereinafter referred to as the "file preparation 
phase"), a y curve table and a colour correction coefficient (a matrix filter), which are basic correction data, 
are calculated to prepare files corresponding to these data and the prepared files are saved in the system. In 
40 the second phase (hereinafter referred to as the "calibration execution phase"), a regular data calibration op- 
eration is performed while a business application is being executed, i.e., image data produced by the scanner 
1 when the scanner 1 reads an image is subjected to correction using the saved y curve table and colour cor- 
rection coefficient 

Fig. 1 also shows a general flow of the file preparation phase out of first and second phases. Further. Fig. 
45 2 shows the processing flow thereof in the form of a flowchart. 

As shown in fig. 2, the file preparation phase starts with a chart file loading operation, step 201, in which 
the host computer 3fir st loads a prestored. or externally inputj ed. cha rtfileS I to the main storage means there- 
" of and then outputs the chart file 31 to the printer 5. The charTf ile ^ is an image data file specially designed 
fQrcaHbra^n, and represents a samplejc hart 51 (see Fig. 4) arranging standard samples of various grey den- 
sities and various colours. In the next step 202, the printer 5 prints out the sample chart 51 upon reception of 
the chart file 31 . A printout of the sample chart 51 exhibits impairment of grey density and colour reproduction^ 
attributable to a non-linear input/output characteristic inherent in the printer 5. 

Then, in step 203, the sample_chajdL5-1--isj:^d by the scanner 1 and the read Image data is fed back to 
the host computer 3.< ffiefed'Sad am^^ a modification of the data as a result of an input/out- 

(Iput characteristic of the scanner 1 being superimposed upon the input/output characteristic of the printer 5. It 
may be noted that in reality, the input/output characteristic of the scanner 1 1s almost linear, and therefore what 
Is substantially exhibited in the fed-back Image data 33 is affected by the non-linear input/output characteristic 
of the printers itself. Hence, the calibration for such image data will hereinafter be called the "printer calibration" 
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in this sense. 

Subsequently, a comparison/editing process 35 is executed by the host computer 3. That is, in step 204 
and 205 predetemiined typical data Is sampled from the fed-back imagedata j3 then in st eps 206 and 208 
the sampled data is compared with the corresponding data ir^ngQrj gjnaTchart data file 31 ^nd edited and in 
steps 207 and 207 a y curve table and a colour correction coeTf^ienTare calculated to prepare files 37 and 
39 respectively, hereinafter referred to as the "y curve file" and "colour correction coefficient file", respectively. 
These files 37 and 39 are not only saved in the host computer 3, but also are sent to the scanner 1 . The scanner 
1 saves both the y curve file 37 and the colour correction coefficient file 39. The file preparation phase is thus 
completed. 

The y curve file 37 Is a data conversion table for performing the printer calibration operation with respect 
to grey density. The colour correction coefficient file 39 is a coefficient array consisting of a 3x3 dimensional 
matrix filter for performing the printer calibration operation with respect to colour. These two data files 37, 39 
will hereinafter be referred to collectively as "calibration data files". These calibration data files have calibration 
contents substantially amounting to an Inverse function of the input/output characteristic of the printer 5. 

Once the calibration data files 37, 39 have been saved In this way, the scanner 1 effects the calibration 
execution phase using these files 37, 39 every time the scanner 1 reads an Image, and sends the calibrated 
image data to the host computer 3. As has already been described, the content of this calibration operation 
substantially amounts to the Inverse function of the input/output characteristic of the printer 5. Therefore, by 
sending the calibrated image data to the printer 5 to cause the printer to make a printout of the calibrated image 
data, the input/output characteristic of the printer 5 and the calibration content cancel each other out, thereby 
allowing a reproduced image having satisfactory grey density and colour reproduction to be printed out. 

As described above, this system is designed to save the calibration data files 37, 39 in the scanner 1 and 
to cause the scanner 1 to execute the printer calibration processing. Therefore, the host computer 3 and the 
printer 5 have nothing to do with the calibratton processing while they are executing a business application 
program. As a result, this system provides an advantage that the host computer 3 is free to change business 
application programs. Further, this system provides another advantage that the calibration processing is easily 
executed if the scanner 1 and the printer 5 are directly connected to each other to "emulate" a copying machine 
without interposing the host computers therebetween. Still further, this system is ready to accommodate such 
possible needs as changing the type of the printer 5 or selecting a single printer out of a plurality of printers 
since the printer does not have to perform the printer calibration processing itself. It may be noted that further 
Improved flexibility can be provided If calibration data files of all the types of printers that are possibly used 
are saved in the host computer 3 to allow the corresponding files to be loaded to the scanner 1 every time the 
printer type is changed, or if calibration data files of all the types of printers are saved in the scanner 1 In ad- 
vance and the conresponding calibration data in the scanner 1 is specified and selected every time the printer 
type is changed. 

A configuration of the scanner 1 of this system will be described next with reference to the block diagram 
of Fig. 3. 

As shown in Fig. 3, a central processing unit 1 01 controls the entire part of the scanner 1 through an ad- 
dress bus 115. A density con-ection section 103, a colour correctfon section 104, an enlargement/reduction 
section 105, a binary processing section 106, a ROM section 107, an Image memory 108, a motor driver 109, 
and an interface 110 are connected to the central processing unit 101 through the address bus 115 and a data 
bus 116. 

An image input section 102 generates image data from an input image by colour-separating the image 
Into the three colour components red (R), green (G), and blue (B), while irradiating the image sent to the scan- 
ner 1 with a beam of light and receiving reflected light at an optical sensor such as an array of CCDs. 

The density correction section 103 receives the Image data from the Image input section 102 and subjects 
the received image data to density conversion. The density correction section 103 has a memory 111. The y 
curve file 37 sent from the host computer 3 through the interface 110 is saved in the memory 111. The density 
conversion processing Is executed using the y curve file 37. 

The colour conrectlon section 104 receives the density-corrected image data and subjects the received 
image data to colour correction. The colour correction section 104 has a memory 112. The colour correction 
coefficient file 39 sent from the host computer 3 through the Interface 110 is saved in the memory 112. The 
colour correction processing is executed using the colour correction coefficient file 39. 

The enlargement/reduction section 105 receives the colour-corrected image data and subjects the re- 
ceived data to enlargement or reduction as the case may so require. Conversion data for executing this en- 
largement/reduction processing is stored in a memory 113. 

The binary processing section 106 receh^es the image data from the enlargement/reduction section 105 
(e.g., 24-bit data) and converts the received image data into data consisting of a smaller number of bits as the 
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case may so require. Conversion data for executing this conversion processing is saved in a memory 114. 

The ROM section 1 07 stores programs including timing data of the whole unit, data for operating the central 
processing unit 101 by processing commands Inputted from the interface 110, and the like. These progranns 
are necessary for operating the central processing unit 101. 
5 The image memory 108 stores the image data processed by the density correction section 103, the colour 

correction section 104, the enlargement/reduction section 105, and the binary processing section 106. and 
holds such data until such data are outputted from the Interface 110. 

The Interface 110 Is a communication Interface with the host computer 3 and outputs image data, inputs 
commands, and Inputs calibration data flies, and the Wke. 
10 The scanner 1 , upon reading the sample chart 51 In the file preparation phase, sends the read image data 

to the host computer 3 through the interface 110 without performing the operations at the density correction 
section 103 and the colour conrection section 104. When the calibration data files 37, 39 have been sent from 
the host computer 3, the scanner 1 stores they curve file 37 In the memory 111 and the colour correction coef- 
ficient file 39 in the memory 112. 
15 On the other hand, in the calibration execution phase in which a business application is being executed, 

the scanner 1 subjects the read image data to processing at the density correction section 103 and the colour 
conrection section 104, and then either sends the thus processed image data to the host computers or directly 
to the printer 5 through the Interface 110. 

The memories 108, 111, 112, 113 and 114 are shown as discrete elements, but could be combined in a 
20 single memory device if desired. 

The foregoing Is an overall description of the calibration operation performed by his system. The file prep- 
aration file, which forms the main part of the calibration operation, will now be described in detail. 

Fig. 4 shows a configuration of the sample chart 51 that is printed out by the printer 4 at the initial stage 
of this phase. This chart 51 includes a colour calibration chart 511 for calculating the colour correction coeff I- 
25 clent and a y calibration chart 513, also called a "grey scale" for calculating the y curve table. As shown in Fig. 
5, the y calibration chart 513 is an array of rectangular regions (each being hereinafter referred to as a "batch") 
extending in a single direction. These batches are printed in 33 tones (0, 7, 15, 239, 247. 255) selected as 
every eighth tone across the total tone range (0 to 255) of grey, where the tones of R, G. and B are the same. 
It may be noted that this grey scale 513 is arranged in two rows to save space in the printed sample chart 51. 
30 As shown in Fig. 5, the colour calibration chart 511 is divided into 9 large square regions, and as shown 

in detail In Fig. 6, each large square region is further divided into 81 small square regions (each small square 
region being hereinafter referred to as a "batch"). In each of the 9 large square regions, the B component is 
changed in 9 tones selected as every thirty second tone (0, 31, .... 223, 225) across the total tone range. In 
each large square region, the R component and the G component are also changed in 9 tones selected as 

35 every thirty second tone (0. 31 223, 225) across the total tone range in the horizontal direction and in the 

vertical direction, respectively. Therefore, the colour calibration chart 511 is constructed of a total of 729 colour 
batches. 

The thus constructed sample chart 51 Is read by the scanner 1 to produce image data, and the image data 
is sent to the host computer 3. The host computer 3 then calculates the y curve table and the colour correction 
40 coefficient from the image data In this case, the y curve table Is calculated first, and the colour correction 
coefficient is calculated thereafter. 

The procedure for calculating the y curve table will be described in detail below. 

Figs. 7 and 8 are graphical representations of the y curve table. Fig. 7 shows an input/output characteristic 
of the printer 5. While the input/output characteristic of the printer 5 more or less varies depending on the com- 
45 ponents R. G. B, there is a common tendency that the input/output characteristic of the printer 5 exhibits a 
non-linear characteristic curving toward the low output side with respect to a linear characteristic (Y = X). This 
curve Is generally called a y characteristic curve. 

To provide an ideal grey density reproduction of a printed-out reproduced Image by having the y charac- 
teristic curve of the printer 6 corrected by the scanner 1, what is required is only that the scanner 1 have a 
so printer calibration y curve such as shown in Fig. 8 (an Inverse function of the printery characteristic curve shown 
in Fig. 7) as an input/output characteristic thereof. It is the y curve table that intentionally imparts this printer 
calibration y curve to the input/output characteristic of the scanner 1 . That is, the y curve table is a description 
of the correspondence between inputs and outputs as shown in Fig. 14. 

Fig. 9 shows in detail a flow of the processing of calculating the printer calibration y curve table to be exe- 
55 cuted by the host computer 3. It may be noted that in Fig. 9 the same steps as in the general flow shown in 
Fig. 2 are denoted by the same reference numbers. 

First, in step 204, data in the y calibration chart 513 is sampled from the image data in the sample chart 
51 inputted from the scanner. The term "sampling" is intended to mean that data in a predetermined central 



7 



EP 0 673 155 A2 



region of each batch, the hatched region as shown in Fig. 10, is picked up. As a result of this sampling operation, 
data for as much as 33 tones is obtained. Since data at each tone consists of the three components R. G. B. 
a total of 99 pieces of data are obtained. 

Then, in step 301, final data for 256 tones Is prepared by interpolating data between each two adjacent 
pieces of data sampled every 8 tones. The data interpolation can be carried out by an ordinary linear interpo- 
lation method. An example of how data interpolation is effected is shown In Fig. 11. As shown in Fig. 11, based 
on the RGB data of a sampled tone and that of the sampled tone next to said sampled tone, the RGB data for 
the 7 tones present between the two sampled tones are calculated by the linear Interpolation method. After 
the data for 256 tones has been obtained in this way, nonnnalisatlon processing with respect to the data for 256 
tones is then executed in Step 302. 

Figs. 12 are a graphical representation of this normalisation processing. The curve Indicated by the solid 
line on the graph of Fig. 12A represents the printer y characteristic curve, the aforementioned data for 256 
tones. One of the features of the y characteristic curve is that tones close to tone 0 (pure black) and tones 
close to tone 256 (pure white) cannot be outputted. In other words, regions close to pure black and pure white 
cannot be printed. The normalisation processing modifies the printer y characteristic curve (the data for 256 
tones) as if the region dose to pure black within the regions that cannot be outputted could be outputted. That 
is. the curve indicated by the solid line on the graph of Fig. 12A is modified into a curve indicted by the broken 
line so as to expand toward the high density (black) side. 

As a result of the modification made by the nonmalisation processing, the finally obtained printer calibration 
y curve becomes the curve indicated by the broken line on the graph of Fig, 12B. If the normalisation processing 
Is not executed, the printer calibration y curve becomes the curve indicated by the solid line on the graph of 
Fig. 128. This calibration y curve Indicated by the solid line means that black is outputted throughout a region 
A that is close to pure black. In contrast, the printer calibration y curve indicated by the broken line on the graph 
of Fig. 12B obtained through the normalisation processing gives output tones that change in accordance with 
Input tones even in the input region A that Is close to pure black. As a result, when the data thus calibrated by 
this y curve Indicated by the broken line on the graph of Fig. 128 is printed out by the printer, a change In tones 
close to pure black in an original image can be reproduced as a change in tones close to the black side edge 
of the printable tone range. That is, the dynamic range dose to the pure black region can be ensured. Accord- 
ingly, an unnatural solid black region is no longer present in a reproduced image, thereby allowing a natural 
reproduced Image to be obtained. 

On the other hand, this normalisation processing is not designed to ensure the dynamic range with respect 
to a region dose to pure white In the printer y characteristic curve, but to only leave such region as a region 
that cannot be outputted. The reason for this is that a region close to pure white, such as a highlighted portion 
In an original Image, looks natural If left pure white (the background colour of the sheet in actuality) in a re- 
produced image thereof and, if tones are given to such region (dotted in actuality), such region looks rather 
unnatural with the dots too conspicuous. 

This normalisation processing is executed using, e.g., thefollowing operation expression for the respective 
RGB data: 

X = {X - Min) * (Max/(Max - Min)) 
where X' is the normalised data, X is the data before being normalised, Min is the minimum value of the data 
before being normalised, and Max Is the maximum value of the data before being normalised. 

After the normalisation processing, the grey scale data in the chart file 31 (meaning the Y = X linear char- 
acteristic) is loaded to the main memory in Step 303, and in Step 304 the chart file data is referenced to the 
previously nonnalised read data so that a calibration y file 37 is prepared. 

Figs. 13and 14 show a specific example of they table preparation processing. Fig. 13 schematically shows 
a table of normalised read data and a table of chart file data (Y = X) In upper and lower sides, respectively, 
where both data are developed in the main memory. 

The y table preparation processing is designed to reverse the read data with Y = X as the central axis. A 
specific operation is as follows. Data In each column of a read data table shown In Fig. 13 is scanned in the 
order of tone and, upon change of the tone to a higher level, the column of the conresponding tone in the chart 
file table is referenced as shown by the arrow. The level of the tone in the read data table and level of the tone 
in the reference chart file table at the time are written as the input value and the output value to the calibration 
y curve table such as shown in Fig. 14. This operation is continued until the read data table Is scanned to the 
last column thereof. Accordingly, the calibration y curve table shown in Fig. 14 can be prepared efficiently. This 
calibration y curve table makes up the calibration y file 37 and is not only saved In the host computer 3, but 
also sent to the scanner 1 so as to be saved in the memory 111 within the scanner 1. 

The operation of calculating a colour correction coefficient file 39 will be described next. The colour cor- 
rection coefficient is in the form of the following 3x3 matrix filter. 
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Defining data before passing through this matrix filter as Rn, Gn. Bn and data after passing therethrough 
! Rm, Gm, Bm, then 



10 



kr 


kg 


kb 




Ir 


Ig 


lb 




mr 


mg 


mg 





Rn 
Gn 
Bn 



Rm 
Gm 
Bm 



[Eq. 2] 
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is given. 

Fig. 1 5 Is a graphical representation of a colour correction coefficient in this system. It may be noted that 
two colour components, R and G, are indicated on a two-dimensional plane and the colour component B is 
omitted to simplify Fig. 15. In Fig. 15, the solid line Indicates data in the colour calibration chart in the chart 
file 31, and the broken line Indicates read data in the chart file 31 (i.e., data that has been modified by the 
Input/output characteristic of the printer). The colour correction coefficient is calculated so that the function of 
recovering the read data Indicated by the broken line to the colour calibration chart data indicated by the solid 
line can be performed. Therefore, when the scanner 1 calibrates the data obtained by reading an original image 
using this colour correction coefficient, a reproduced Image having colours of the original Image extremely 
faithfully reproduced by be obtained with the effect of the calibratton and the Input/output characteristic of the 
printer cancelling each other out. 

Fig. 1 6 shows a flow chart of the process of calculating a colour conrection coefficient performed by the 
host computer 3. It may be noted that in Fig. 16. the same steps as those in Fig. 2 are denoted by the same 
reference numerals. 

In Fig. 16. the following data for 21 colours is first sampled from the data obtained by reading the colour 
calibration chart 511 in the sample chart 51 In Step 205. It may be noted that the position of each batch of 
these 21 colours in the sample chart 51 Is indicated in Fig. 4, 
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The feature common to these 21 colours is that the tones range from 63 to 191 . This range is determined 
by reference the aforementioned calibration y curve table or y curve file 37 so as to be within the range of tones 
that can be outputted by the printer 5. That is. data is sampled from the range of tones that can be outputted 
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by the printer 5. The reason therefor is to allow faithful colour reproduction to be Implemented within the range 
of tones that can be outputted by the printer 5. In other words, emphasis is placed on improving grey density 
and colour reproduction of half tones, not the primary colours (which are out of the range of tones that can be 
outputted by the printer 5). As a result of this design, satisfactory grey density and colour reproduction can be 
ensured for an original image such as an ordinary photograph in which there are many halftone colours. 

On the other hand, with respect to the original Image such as an artificially depicted poster using many 
primary colours, there is a demand that the primary colours be reproduced as dearly as possible. To meet 
such a demand, It is necessary that data be sampled from regions close to the primary colours which is outside 
of the range of tones that can be outputted by the printer 5. Therefore, if a mode that performs the operation 
of sampling data from outside of the range of tones that can be outputted by the printer 5 is added to this em- 
bodiment, then two kinds of colour correction coefficients which satisfy the aforementioned two demands can 
be obtained, and these colour correction coefficients can be used in accordance with the application, thereby 
improving user-friendliness. 

The aforementioned sampling operation extracts data only In the central portion of the batch, as shown 
in Fig. 10, out of the read data for the 21 colours. A total of 63 pieces of data are sampled since each of the 
21 colours includes the 3 colour components R, G and B. 

Then, In step 401 , the sampled read data is subjected to y characteristic calibration using the previously 
obtained y curve table from Step 207. A colour conrection coefficient is thereafter calculated in Step 402 from 
the y-calibrated read data. The colour correction coefficient is calculated in the following way using the least- 
squares method so that error between the colour calibration chart data in the chart file 31 and the correspond- 
ing read data is minimised. 

If it is assumed that the read data for the 21 colours are defined as (Rgi, Ggi, Bgi) (1 = 1 21) and that 

the corresponding data for the 21 colours in the chart file are defined as (Rsi, Gsi, Bsi) (i = 1 21), then the 

colour corriBctlon coefficient is determined so that an average square error between both data for each of the 
R, G, B components, I.e.. 



21 21 21 

I(Rsi.Rgi)2; I (Gsi- Ggi )2; Z (Bsi- Bgi )2; [Eq. 3] 

1-1 i=l i=i 



is minimised. 

The coefficient is determined by solving the following equation. 



^fRg') EiRgGo) ZlRa^o) f 

^i^SBs) LiGsBg) zl^zf \ I9 mg 



r RsGg CCGsGg) r (BsGg 
J=(RsBg) ECGsBg) E(BsBg 



ib mb I 

CEq- 4] 



21 

where 2 is the abbreviation of ^ ^ and Rs, Gs, Bs, Rg, Gg, and Bg are the abbreviations of Rsi, Gsi, Bsi, Rgi, 
Ggi, and Bgi, respectively. 

That is, the colour conrection coefficient can be calculated by executing the following arithmetic operation. 
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where is the inverse matrix and "T" is the transposed matrix. 

The thus calcuiated colour correction coefficient is called a temporary colour correction coefficient. This 
temporary colour correction coefficient Is subjected to nomnallsatlon processing in Step 403. The normalisation 
pixicessing modifies the temporary colour correction coefficient so that the sum of each column (kr + kg + kb), 
(Ir + Ig + lb), (mr + mg + mb). which is the lightness component of the temporary colour correction coefficient! 
becomes equal to one another ( = 1). More specifically, each of coefficients kr, kg. kb of the column k is divided 
by the sum of the column k (kr + kg + kb). each of coefficients Ir. Ig. lb of the column 1 Is divided by the sum 
of the column 1 (Ir + Ig + lb), and each of coefficients mr. mg, mb of the column m is divided by the sum of the 
column m (mr + mg + mb). 

This normalisation processing provWes an advantage that grey balance is not lost. That is. in the case 
where the read data indicating grey (R, G. B have the same tone) is multiplied by the colour correction coef- 
ficient (see Eq. 2), if the temporary colour correction coefficient is used without normalisation, then the data 
after the multiplication is such that R, G. B have different tone levels since the sums of the respecth/e columns 
(lightness component) are usually different from one another. This means that the read data after such mul- 
tiplication exhibits a colour other than grey (achromatic colour). In contrast thereto. If the normalised colour 
conrection coefficient is used, the read data after multiplication exhibits grey since the sums of the respective 
columns are equal to 1, thereby allowing grey balance to be maintained. The thus normalised colour correction 
coefficient is not only saved In the host computer 3 as the final colour correction coefficient file 39. but also 
sent to the scanner 1 to be saved in the memory 112 within the scanner 1 . 

While a preferred embodiment of the invention has been described above, the invention is not limited there- 
to, but may be embodied in various other modes without departing from the scope and spirit thereof. For ex- 
ample, the invention may be embodied in copying machines and facsimile communication systems. Also the 
invention may be embodied for non-colour machines Instead of the colour machines described above. 

As described in the foregoing, the invention is characterised as obtaining satisfactory grey density and 
colour reproduction even if there Is a discrepancy In Input/output characteristic between an Image reading de- 
vice and a printing device in a colour image processing system. In addition, once the calibration data has been 
obtained, a single autonomously functioning system can be fonmed only of the image reading device and the 
printing device themselves thereafter, which is highly useful as well as applicable to a variety of fields. 

The foregoing description of preferred embodiments of the invention has been presented for purposes of 
illustration and description. It is not intended to be exhaustive or to limit the invention to the precise form dis- 
closed, and modifications and variations are possible in light of the above teachings or may be acquired from 
practice of the invention. The embodiments were chosen and described in order to explain the principles of 
the invention and its practical application to enable one skilled in the art to utilise the invention In various em- 
bodiments and with various modifications as are suited to the particular use contemplated. It is intended that 
the scope of the Invention be defined by the claims appended hereto, and their equivalents. 

This inventfon provides a data correction method for a colour Image processing system having a colour 
image reading device and a colour image printing device, comprising the steps of: 

transmitting a chart file to the printing device so that the printing device produces a sample chart; 
calculating calibration data from read sample data so that the read sample data can be con-ected to'cor- 
responding data in the chart file, the read sample data being obtained by causing the reading device to read 
the sample chart; and 

conrecting printing data to be transmitted to the printing device using the calibration data. 
This invention provides an image processing system, comprising: 
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a colour image reading device; 
a colour image printing device; 

transmitting means for transmitting a chart file to the printing device so that the printing device produces 
a sample chart; 

calibration data calculation means for calculating calibration data from read sample data so that the read 
sample data can be conrected to corresponding data in the chart file, the read sample data being obtained by 
causing the reading device to read the sample chart; and 

calibration means for correcting printing data to be transmitted to the printing device using the calibration 

data. 

This Invention provides a data correction subsystem for an Image processing system having an image 
reading device and an image printing device, the data correction subsystem comprising: 

means for transmitting a chart file to the printing device such that the printing device produces a sample 

chart; 

means for comparing first image data with the chart file, the first Image data being produced by the 
Image reading device upon a reading of the sample chart by the image reading device; 

means for calculating calibration data in accordance with the comparison of the first Image data with 
the chart file; and 

means for transmitting the calibration data to the image reading device so that second image data pro- 
duced by the image reading device upon a reading of an Image by the image reading device is conrected In 
accordance with the calibration data. 

This invention provides a data correction method for an image processing system having an image reading 
device and an image printing device, the data correction method comprising the steps of: 

transmitting a chart file to the printing device such that the printing device produces a sample chart; 

comparing first image data with the chart file, the first Image data being produced by the image reading 
device upon a reading of the sample chart by the image reading device; 

calculating calibration data In accordance with the comparison of the first image data with the chart file; 

and 

transmitting the calibration data to the image reading device so that second image data produced by 
the image reading device upon a reading of an image by the image reading device is corrected in accordance 
with the calibration data. 

This invention provides an Image processing method, comprising the steps of: 

printing a sample chart in accordance with a chart file; 

reading the chart file to produce first image data; 

comparing the first image data with the chart file; 

calculating calibration data in accordance with the comparison of the first image data with the chart file; 
reading an Image to produce second image data; and 
correcting the second image data In accordance with the calibration data. 
The aforegoing description has been given by way of example only and it will be appreciated by a person 
skilled in the art that modifications can be made without departing from the scope of the present invention. 



Claims 

1. A data correction subsystem for an image processing system having an image reading device and an im- 
age printing device, the data correction subsystem being characterised by comprising: 

transmitting means for transmitting a chart file to the printing device so that the printing device 
produces a sample chart; 

calibration data calculation means for calculating calibration data from read sample data so that 
the read sample data can be corrected to conrespondlng data in the chart file, the read sample data being 
obtained by causing the reading device to read the sample chart; and 

calibration means for correcting printing data transmitted to the printing device using the calibration 

data. 

2. A data correction subsystem according to claim 1 wherein the read sample data is first image data being 
produced by the image reading device upon a reading of the sample chart by the Image reading device; 

the calibration data calculation means calculating calibration data In accordance with the compar- 
ison of the first Image data with the chart file; and further comprising 

means for transmitting the calibration data to the image reading device so that second image data 
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produced by the image reading device upon a reading of an image by tiie image reading device is cor- 
rected in accordance with the caiibration data. 

A data con-ection subsystem according to claim 1 or claim 2 wherein the image processing system is a 
colour image processing system having a colour Image reading device and a colour image printing device. 

A data correction subsystem according to claim 3, wherein the calibration data Includes y calibration data 
for correcting grey density and colour calibration data for conrecting a colour, and the calibration means 
subjects the printing data first to grey density conrection using the y calibration data and then to colour 
correction using the colour calibration data. 

A data correction subsystem according to claim 4, wherein the colour calibration data is a 3x3 matrbc filter 
by which three primary colour components of the printing data are multiplied. 

A data correction subsystem according to any preceding claim, wherein a plurality of different types of 
printing devices can be used selectively or concurrently as the printing device, and wherein the data cor- 
rection subsystem further comprises: 

calibration data storing means for storing calibration data calculated respectively for each of the 
plurality of types of Drinting devices; and 

calibration data selection means for selecting calibration data for a type of printing device to be 
used from the stored calibration data and for supplying the selected calibration data to the calibration 
means. 

A data con-ection subsystem according to any preceding daim. wherein the calibration data includes y 
calibration data for correcting a grey density, and wherein the calibration data calculation means com- 
prises: 

grey density normalisation means for subjecting the read sample data to normalisation processing 
to expand a grey density distribution region of the read sample data toward a higher density side; and 

conversion data calculation means for calculating conversion data for correcting a grey density of 
the normalised read sample data to a grey density of the chart file data and making the calculated con- 
version data the y calibration data. 

A data conrection subsystem according to any preceding claim, wherein the calibration data includes y 
calibration data for conrecting a grey density, and wherein the calibration data calculation means com- 
prises: 

density change detection means for detecting a point of change in a density value by scanning grey 
density values of the read sample data in a single direction; and 

conversion data preparation means for preparing conversion data for converting the grey density 
value of the read sample data at the detected point of change Into a grey density value of the chart file 
data corresponding to the point of change and making the prepared conversion data the y calibration data. 

A data correction subsystem according to any one of claims 3 to 5, wherein the calibration data includes 
colour calibration data for conrecting a colour, and wherein the calibration data calculation means com- 
prises: 

colour sampling means for sampling only colour data in the chart file from the read sample data, 
the colour data corresponding to a predetermined colour within a range of colours that can be output by 
the printing device; and 

conversion data calculation means for calculating conversion data for conrecting the colour data 
sampled from the read sample data to corresponding data In the chart file and making the conversion 
data the colour calibration data. 

A data correction subsystem according to any one of claims 3 to 5 or 9, wherein the calibration data in- 
cludes colour calibration data for correcting a colour, and wherein the calibration data calculation means 

comprises: 

colour sampling means for sampling only colour data in the chart file from the read sample data, 
the colour data corresponding to a predetermined colour outside a range of coloure that can be output by 
the printing device; and 

conversion data calculation means for calculating conversion data for correcting the colour data 
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sampled from the read sample data to corresponding data in the chart file and making the conversion 
data the colour calibration data. 

11. A data con-ection subsystem according to any one of claims 3 to 5, 9 or 10. wherein the calibration data 
includes colour calibration data for correcting a colour, and wherein the calibration data calculation means 
comprises: 

matrixf liter calculation means for calculating a 3x3 matrix filter to minimise an error between three 
primary colour component values of the read sample data and three primary colour component values of 
the chart file data; and 

matrix nonmalisatioh means for executing normalisation processing to make lightness components 
with respect to the three primary colours of the calculated matrix filter equal to one another and making 
the thus normalised matrix filter the colour calibration data. 

12. A data correction method for an image processing system having an image reading device and an image 
printing device, comprising the steps of: 

transmitting a chart file to the printing device so that the printing dbvice produces a sample chart; 

calculating calibration data from read sample data so that the read sample data can be corrected 
to corresponding data In the chart file, the read sample data being obtained by causing the reading device 
to read the sample chart; and 

correcting printing data to be transmitted to the printing device using the calibration data. 

13. A data confection method according to claim 12, wherein the read sample data is first Image data being 
produced by the image reading device upon a reading of the sample chart by the image reading device; 
and comprising the steps of: 

calculating calibration data in accordance with the comparison of the first image data with the chart 
file; and 

transmitting the calibration data to the image reading device so that second image data produced 
by the image reading device upon a reading of an image by the Image reading device is corrected in ac- 
condance with the calibration data. 

14. A data correction method according to claim 12 or claim 13, wherein the Image processing system Is a 
colour image processing system having a colour image reading device and a colour image printing device. 

15. An Image processing system, comprising: 

an image reading device; 
an image printing device; 

transmitting means for transmitting a chart file to the printing device so that the printing device 
produces a sample chart; 

calibration data calculation means for calculating calibration data from read sample data so that 
the read sample data can be corrected to conresponding data in the chart file, the read sample data being 
obtained by causing the reading device to read the sample chart; and 

calibration means for correcting printing data to be transmitted to the printing device using the cal- 
ibration data. 

16. An image processing system according to claim 15 and comprising: 

a data correction subsystem, the data correction subsystem including 
said transmitting means; 

said calibration data calculatton means comprising; 

means for comparing first Image data with the chart file, the first image data being produced by 
the image reading device upon a reading of the sample chart by the image reading device, and 

means for calculating calibration data in accordance with the comparison of the first image data 
with the chart file, and the data correction subsystem also including; 

means for transmitting the calibration data to the image reading device so that second image data 
produced by the image reading device upon a reading of an image by the image reading device is cor- 
rected in accordance with the calibration data. 

17- An image processing system according to daim 15 or daim 16, wherein the image reading device com- 
prises a calibration data storage means for storing the calibration data obtained by the calibration data 
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calculation means, and wherein the calibration means is provided in the image reading device. 

18. Am image processing system according to any one of claims 15 to 17, wherein said system is a colour 
image processing system comprising a colour image reading device and a colour image printing device. 

19. An image processing method comprising the steps of: 

printing a sample chart in accordance with a chart file; 
reading the chart file to produce first image data; 
comparing the first Image data with the chart file; 

calculating calibration data in accordance with the comparison.of the first Image data with the chart 

file; 

reading an image to produce second image data; and 

correcting the second image data in accordance with the calibration data. 

20. An image processing method according to daim 19. wherein the step of calculating the calibration data 
Includes the steps of calculating y calibration data and calculating colour calibration data, and wherein 
the step of correcting the second image data includes the steps of correcting a grey density of the second 
image data in accordance with the y calibration data and correcting a colour of the second image data in 
accordance with the colour calibration data. 

21. An image processing method according to claim 19 or claim 20, wherein the printing step, the first reading 
step, the comparing step, and the calculating step are performed a plurality of times to produce calibration 
data for a plurality of corresponding printing devices, and wherein the method further comprises the step 
of storing the calibration data for at least one of the plurality of printing devices. 
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